Skip to main content

Aggregations and Calculations

Overview

The Aggregations and Calculations package processes validated meter data to perform specific calculations and create virtual datasources. It supports mathematical functions, logical operations, and specific business calculations such as network area aggregations and energy community metrics.

Process Flows

Network Area Calculations

Aggregate Data

  • System aggregates data from all datasources belonging to a network area
  • Aggregation can be performed across different time periods (hourly, daily, monthly)

Store Aggregated Results

  • Results are stored as a virtual datasource
  • Virtual datasources can be used like regular datasources in downstream processes

Energy Communities Calculations

Calculate Total Consumption

  • Aggregates consumption from all datasources within the energy community
  • Calculates totals for each interval period

Calculate Total Self-Consumption

  • Determines how much produced energy was used within the energy community
  • Calculations performed for each interval period

Calculate Self-Consumption per Metering Point

  • Determines how much produced energy was used by each metering point
  • Allocates self-consumption based on configurable rules

Calculate Grid Consumption per Metering Point

  • Determines how much energy was consumed from the external grid
  • Distinguishes between self-generated and grid-supplied energy

Business Rules & Customization Points

Calculation Rules

  1. Formula Calculation
    • Rule : Standard_Formulae_Calculation
    • Purpose : Executes configurable mathematical and logical operations on datasources. The formula should be defined in a datasource tag defined in the standard_constants as FORMULAE_CALCULATION_TAG_NAME (default = calculation).
    • Customization : Create custom formulas for specific business needs

The formula calculation engine supports various mathematical operations:

  • Basic arithmetic (addition, subtraction, multiplication, division)
  • Statistical functions (average, min, max, standard deviation)
  • Logical operations (if-then-else, comparisons)
  • Time-based functions (time shifting, interpolation)
  • Aggregations (sum, count, group by)

Trigger Schedules

The system includes various trigger schedules for different calculation types:

  • Daily community aggregation (BQ_Community_Aggregation_Daily_Trigger)
  • Monthly community aggregation (BQ_Community_Aggregation_Monthly_Trigger)
  • Daily community calculation (BQ_Community_Calculation_Daily_Trigger)
  • Monthly community calculation (BQ_Community_Calculation_Monthly_Trigger)
  • Daily network area aggregation (BQ_Network_Area_Aggregation_Daily_Trigger)
  • Monthly network area aggregation (BQ_Network_Area_Aggregation_Monthly_Trigger)

Customization : Partners can adjust trigger schedules to match business requirements

Transformation Configurations

  • BQ_Community_Aggregation_Ingest_Tc
  • BQ_Calculate_Metering_Point_Self_Consumption_Tc
  • BQ_Network_Area_Aggregation_Ingest_Tc

Customization : Modify transformation configurations to support specific calculation methods

Implementation Considerations

Formula Complexity

  • Complex formulas may impact system performance
  • Consider breaking down complex calculations into smaller steps

Data Quality Dependencies

  • Aggregations rely on validated data
  • Implement clear handling for missing or questionable input data

Temporal Consistency

  • Ensure all datasources use consistent time intervals
  • Handle time zone differences appropriately

Calculation Versioning

  • Business rules may change over time
  • Consider implementing versioning for calculation methods

Configuration Components

Flow Designs

  • Standard_Formulae_Calculation_Start_End_Flow

Market Adapter Configurations

  • BQ_Community_Aggregation_Ingest_Ma
  • BQ_Calculate_Metering_Point_Self_Consumption_Ma
  • BQ_Network_Area_Aggregation_Ingest_Ma

Customization Opportunities

Partners can customize this module by:

  1. Creating specialized calculation formulas for industry-specific metrics
  2. Implementing custom allocation rules for energy communities
  3. Adding new aggregation levels (building, substation, feeder)
  4. Developing bespoke calculations for regulatory reporting
  5. Implementing forecasting calculations based on historical aggregates